AITopics | pseudo ground-truth piano roll

Collaborating Authors

pseudo ground-truth piano roll

Information about AI from the News, Publications, and Conferences

Automatic Classification – Tagging and Summarization – Customizable Filtering and Analysis

If you are looking for an answer to the question What is Artificial Intelligence? and you only have a minute, then here's the definition the Association for the Advancement of Artificial Intelligence offers on its home page: "the scientific understanding of the mechanisms underlying thought and intelligent behavior and their embodiment in machines."

However, if you are fortunate enough to have more than a minute, then please get ready to embark upon an exciting journey exploring AI (but beware, it could last a lifetime) …

Review for NeurIPS paper: Audeo: Audio Generation for a Silent Performance Video

Neural Information Processing SystemsJan-22-2025, 14:29:17 GMT

Summary and Contributions: This paper proposes a novel pipeline approach for improving piano music/audio generation from silent videos with a top-view of a pianist's fingers playing on a keyboard. Prior work [27] used an end-to-end approach to directly predict a symbolic piano performance from video using ResNets. This paper points out there's a lot of mismatch between the video and music/audio streams and hence the processing requires multiple stages of transformation. The proposed pipeline consists of three interpretable components / stages. Video2Roll consists of three stages.

audio generation, pseudo ground-truth piano roll, silent performance video, (6 more...)

Neural Information Processing Systems

Industry:

Leisure & Entertainment (0.79)
Media > Music (0.38)

Technology: Information Technology > Artificial Intelligence (0.38)

Add feedback